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~ The MAILING DATE of this communication appears on the cover sheet with the correspondence address- 

All claims being allowable, PROSECUTION ON THE MERITS IS (OR REMAINS) CLOSED in this application. If not included 
herewith (or previously mailed), a Notice of Allowance (PTOL-85) or other appropriate communication will be mailed in due course. THIS 
NOTICE OF ALLOWABILITY IS NOT A GRANT OF PATENT RIGHTS. This application is subject to withdrawal from issue at the initiative 
of the Office or upon petition by the applicant. See 37 CFR 1.313 and MPEP 1308. 

1 . This communication is responsive to 9/21/10 . 

2. The allowed claim(s) is/are 7, 4, 7-9, 11-15, 17, 19, 20, 23, 24, 26, 29, 30, 33-35, 40, and41 . 

3. □ Acknowledgment is made of a claim for foreign priority under 35 U.S.C. § 1 1 9(a)-(d) or (f). 

a) □ All b) □ Some* c) □ None of the: 

1 . □ Certified copies of the priority documents have been received. 

2. □ Certified copies of the priority documents have been received in Application No. . 

3. □ Copies of the certified copies of the priority documents have been received in this national stage application from the 

International Bureau (PCT Rule 17.2(a)). 
* Certified copies not received: . 

Applicant has THREE MONTHS FROM THE "MAILING DATE" of this communication to file a reply complying with the requirements 
noted below. Failure to timely comply will result in ABANDONMENT of this application. 
THIS THREE-MONTH PERIOD IS NOT EXTENDABLE. 

4. □ A SUBSTITUTE OATH OR DECLARATION must be submitted. Note the attached EXAMINER'S AMENDMENT or NOTICE OF 

INFORMAL PATENT APPLICATION (PTO-152) which gives reason(s) why the oath or declaration is deficient. 

5. □ CORRECTED DRAWINGS ( as "replacement sheets") must be submitted. 

(a) □ including changes required by the Notice of Draftsperson's Patent Drawing Review ( PTO-948) attached 

1) □ hereto or 2) □ to Paper No./Mail Date . 

(b) □ including changes required by the attached Examiner's Amendment / Comment or in the Office action of 

Paper No./Mail Date . 

Identifying indicia such as the application number (see 37 CFR 1 84(c)) should be written on the drawings in the front (not the back) of 
each sheet. Replacement sheet(s) should be labeled as such in the header according to 37 CFR 1.121(d). 

6. □ DEPOSIT OF and/or INFORMATION about the deposit of BIOLOGICAL MATERIAL must be submitted. Note the 

attached Examiner's comment regarding REQUIREMENT FOR THE DEPOSIT OF BIOLOGICAL MATERIAL. 
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Remarks 

1 . This Office action is responsive to the Request for Continued Examination (RCE) 
filed under 37 CFR §1 .53(d) for the instant application on 9/21/10 . Applicants have 
properly set forth the RCE, which has been entered into the application, and an 
examination on the merits follows herewith. 

This Office action is responsive to the amendment filed on 9/21/10, which has 
been entered in the above identified application. 

Information Disclosure Statement 

2. Non patent literature documents 10 (Olson, Robert et al), 1 1 (Engel, Klaus et al), 
and 12 (Engel, K., et al) of the information disclosure statement filed 5/10/04 fails to 
comply with the provisions of 37 CFR 1.97, 1.98 and MPEP § 609 because applicants 
failed to provide a publication date as required by 37 CFR 1 .98 (b)(5). 

3. Non patent literature document 3 (Dunn, et al) of the information disclosure 
statement filed 1/24/08 fails to comply with the provisions of 37 CFR 1 .97, 1 .98 and 
MPEP § 609 because applicants failed to provide a publication date as required by 37 
CFR 1.98 (b)(5). 

4. The Information disclosures have been placed in the application file, but the 
information that has been stricken by the examiner has not been considered as to the 



Application/Control Number: 10/782,732 Page 3 

Art Unit: 2172 

merits. Applicant is advised that the date of any re-submission of any item of information 
contained in this information disclosure statement or the submission of any missing 
element(s) will be the date of submission for purposes of determining compliance with 
the requirements based on the time of filing the statement, including all certification 
requirements for statements under 37 CFR 1 .97(e). See MPEP § 609.05(a). 

EXAMINER'S AMENDMENT 

5. An examiner's amendment to the record appears below. Should the changes 
and/or additions be unacceptable to applicant, an amendment may be filed as provided 
by 37 CFR 1 .31 2. To ensure consideration of such an amendment, it MUST be 
submitted no later than the payment of the issue fee. 

Authorization for this examiner's amendment was given in a telephone interview 
with Kristina Kuhnert on 1/4/1 1 . 

6. The application has been amended as follows: 

Please amend claims 1, 7, 8, 12, 17, 20, 24, 26, 29, 33, and 35 as follows: 

Claim 1: 

On [line 12] of the claim, please change "a dynamic change" to --dynamic 
changes--. 
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On [line 16] of the claim, please change "adding a node to the media timeline, 
removing a node of the media timeline, or changing a node of the media timeline" to -- 
adding a node to the media timeline--. 

Claim 7: 

On [line 2] of the claim, please change "the application" to -an application--. 

Please amend Claim 8 as follows: 

A method as described in claim 1 , wherein at least one node of the one or more 
nodes referencing respective media is configured to reference an effect to be applied to 
an output of the respective media referenced by the at least one node. 

Please amend Claim 12 as follows: 

A computer-implemented method comprising computer-executable instructions, 
the method comprising: 

receiving a call from an application over an API for rendering a media timeline, 
wherein: 

the media timeline includes a plurality of nodes, wherein the plurality of 
nodes comprises at least a parent node and a child node; 
two or more nodes reference respective media; 
the media timeline defines one or more presentations including media; 
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rendering the media timeline to output each presentation to an output device, 
wherein the rendering further comprises dividing the media timeline into the one or more 
presentations such that each presentation describes a collection of software 
components utilized to render media for a particular interval of time, wherein the 
collection of software components include a transform and comprise at least one of a 
timeline source configured to support a dynamic changes to the media timeline, a media 
source, a media session, a media engine, a source resolver, and a media sink; 

generating, by a node, one or more events ut ili zed to i nform a ll othor nodes of a 
nodo troo affoctod by tho ono or moro ovonts of a dynam i c change i n tho mod i a 
t i mo li no, tho change perform i ng at l oast ono of tho fo ll ow i ng: that dynamically change 
the media timeline, the dynamic change comprising: 

chang i ng to a property of tho at loact ono nodo; 

adding one or more additional nodes as a child to the at l oast ono 

node; 

remov i ng ono or moro nodos that aro ch il dren of tho at l oast ono 

add i ng an offoct to tho at loast ono nodo; and 
remov i ng an effect from tho at l oast ono nodo; 
loading each software component described by a first collection; 
executing each software component described by the first collection; and 
loading each software component described by a second collection. 
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Please amend Claim 17 as follows: 

A method as described in claim 12, wherein at least one node of the two or more 
nodes referencing respective media is configured to reference an effect to be applied to 
an output of the respective media referenced by the at least one node. 

Please amend Claim 20 as follows: 

One or more computer-readable storage media comprising computer executable 
instructions that, when executed on a computer, direct the computer to divide a media 
timeline into one or more presentations, wherein: 

the media timeline is for exposure via an API to one or more applications; 

the media timeline includes a plurality of nodes, wherein the plurality of nodes 
comprises at least one node configured to generate one or more events communicated 
to at least one parent node and a child node, the one or more events dynamically 
changing the media timeline, the dynamic change comprising adding a node to the 
media timeline, and the communicating comprising subscribing to receive an indication 
of an event that affects the parent node or the child node; 

at least two nodes reference respective media; 

each presentation describes rendering of respective media to an output device 
for a particular interval of time, wherein each presentation describes a collection of 
software components that, when executed, provide the described rendering of media for 
the particular interval of time, and wherein the collection of software components 
include a transform and comprise at least one of a timeline source configured to support 
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a dynamic changes to the media timeline, a media source, a media session, a media 

engine, a source resolver, and a media sink; and 

the one or more computer-readable storage media further comprises computer 

executable instructions that, when executed on the computer, direct the computer to: 
load each software component described by a first collection; 
execute each software component described by the first collection; and 
load each software component described by a second collection. 



Please amend Claim 24 as follows: 

The one or more computer-readable storage media as described in claim 20, 
wherein at least one node of the at least two nodes referencing respective media is 
configured to reference an effect to be applied to an output of the respective media 
referenced by the at least one node. 



Please amend Claim 26 as follows: 
A system comprising: 
a memory; 

a processor coupled to the memory; 
a plurality of media; 
a plurality of applications; and 
an infrastructure layer that: 
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provides an API for the plurality of applications which exposes a 
media timeline that describes one or more presentations of the plurality of 
media; and 

manages rendering of the one or more presentations, wherein each 
presentation describes rendering of media to an output device for a 
particular interval of time, and wherein each presentation describes a 
collection of software components configured for dynamic loading such 
that the collection of software components provide the described 
rendering of the media for the particular interval of time, wherein the 
collection of software components include a transform and comprise at 
least one of a timeline source configured to support a dynamic changes to 
the media timeline, a media source, a media session, a media engine, a 
source resolver, and a media sink, wherein the collection of software 
components are loaded only when needed, 

the media timeline includes a plurality of nodes; 
at least two nodes reference respective media; and 
at l oast ono nodo i s conf i gured for commun i cat i on of ovonts gonoratod by 
tho at l oast ono nodo, tho ovonts uti li zed to i nform a ll othor nodos of a nodo troo 
affoctod by tho ovonts of a change to bo mado to tho structure of tho mod i a 
t i mo li no wh il o tho mod i a t i mo li no is rondorod generating, bv at least one node, 
one or more events that dynamically change the media timeline, the dynamic 
change comprising adding a node to the media timeline . 
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Claim 29: 

On [line 3] of the claim, please change "described" to --described by a respective 
presentation--. 

Claim 33: 

On [line 87 of the claim, please change "adding a node to the media timeline, 
removing a node of the media timeline, or changing a node of the media timeline" to - 
adding a node to the media timeline--. 

Claim 35: 

On [line 2] of the claim, please change "topology is for" to -topology for-. 

Allowable Subject Matter 

7. Claims 1 , 4, 7-9, 1 1 -1 5, 1 7, 1 9, 20, 23, 24, 26, 29, 30, 33-35, 40, and 41 are 
allowed. 

8. The following is an examiner's statement of reasons for allowance: 

Examiner has carefully considered claims 1 , 4, 7-9, 11-15, 17, 19, 20, 23, 24, 26, 
29, 30, 33-35, 40, and 41 . None of the cited arts of records discloses, suggests, nor 
teaches a method, computer readable storage medium, system, or timeline source 
comprising a media timeline having one or more nodes referencing respective media 
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and divided into one or more presentations wherein each presentation describes a 
rendering of the media for a particular interval of time, and wherein each presentation 
describes a collection of software components that, when executed, provides the 
described rendering of the media for the particular interval of time, wherein the 
collection of software components include a transform and comprise at least one of a 
timeline source configured to support dynamic changes to the media timeline, a first 
media source, a media session, a media engine, a source resolver, or a media sink; 
generating, by a node, one or more events that dynamically change the media timeline, 
the dynamic change comprising adding a node to the media timeline . 

The closest prior art, Sheasby et al (U.S. Patent No. 6,539,163 B1), discloses 
using non-linear editors where clip objects representing the material being edited are 
positioned and manipulated with respect to a timeline to create an output sequence for 
the work being created [column 1, lines 14-20]. Conventional NLE system have 
permitted video, computer generated graphics, audio, and indirectly, film media to be 
edited and various effects to be applied to the media [column 1, lines 20-23]. A non- 
linear editing system sequence has clips within a timeline [figure 1; column 3, lines 10- 
25] using parent and child sequences [column 4, lines 4-8, 20-34] Sequences are 
played back on output devices [column 9, lines 41-47]. Each track may include multiple 
clips [column 3, lines 10-20] as well as various effects applied to the clips [column 3, 
lines 20-25] The parent/child sequences allow modification of a child sequence to be 
automatically used by the parent sequence without requiring a separate modification 
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[column 6, lines 13-20]. Reference clips are loaded and played back [column 6, lines 
53-63]. Sheasby does not teach all the limitations above. 

Similar subject matter is disclosed in independent claims 12, 20, 26, and 33. 

Any comments considered necessary by applicant must be submitted no later 
than the payment of the issue fee and, to avoid processing delays, should preferably 
accompany the issue fee. Such submissions should be clearly labeled "Comments on 
Statement of Reasons for Allowance." 

9. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to ALVIN H. TAN whose telephone number is (571)272- 
8595 . The examiner can normally be reached on Mon-Fri 9:00-5:30. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Boris Pesin can be reached on 571-272-4070. The fax phone number for 
the organization where this application or proceeding is assigned is 571-273-8300. 
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Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 
USPTO Customer Service Representative or access to the automated information 
system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 



/Alvin H Tan/ 

Primary Examiner, Art Unit 2172 



